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SPECIFICATION 
TO ALL WHOM IT MAY CONCERN: 

Be it known that Daryl Lawton, citizen of the United States of America, and resident at 
15127 NE 24 th Street #410, Redmond, Washington, 98052, Alexandra W. Loeb, citizen of the 
United States of America, and resident at 3910 Sunnyside Avenue N, Seattle, Washington, 
98103, Henry W. Burgess, citizen of the United States of America, and resident at 17615 NE 
152 nd Street, Woodinville, Washington, 98072, and Eric J. Feigin, citizen of the United States 
of America, and resident at 2129 Florida Avenue NW #604, Washington, DC, 20008 have 
invented a certain new and useful METHOD AND SYSTEM FOR BROWSING A LOW- 
RESOLUTION IMAGE of which the following is a specification. 
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METHOD AND SYSTEM FOR BROWSING A LOW- RESOLUTION IMAGE 

FIELD OF THE INVENTION 

5 This invention relates generally to the field of 

information display and, more particularly, relates to a 
method and system for browsing or rapidly accessing the 
contents of a low-resolution image. 

10 BACKGROUND OF THE INVENTION 

It is known in the computer art to use a thumbnail 
image to provide a representation of a full -sized image 
stored on a computer. In its current embodiment, the 
thumbnail image is merely a low-resolution version of the 

15 full-sized image created, for example, by sub-sampling the 
full-sized image. Associated with the thumbnail image is a 
link, such as a hyperlink. The link may be used to access 
the computer storage location of the full-sized image 
counterpart of the thumbnail image whereby the full -sized 

20 image may be retrieved and displayed. 

To retrieve the full-sized image, a user is typically 
required to interact with the displayed thumbnail image. 
This interaction is often accomplished by positioning a 
cursor over a portion of the thumbnail image. Once the 

25 cursor is positioned over the thumbnail image, the thumbnail 
image may be selected, for example, by clicking an 
appropriate mouse button. In response to this interaction, 
the application associated with the display of the thumbnail 
image, such as a Web browser, initiates the retrieval of the 
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entire full-sized image from its storage location. Once 
retrieved, the entirety of the full-sized image is available 
for display. 

Methods for creating thumbnail images are also well 
5 known in the art. By way of example, Microsoft's 

"FRONTPAGE" brand Web site creation and management tool 
provides the software needed to create thumbnail images. 
Using the "FRONTPAGE" brand editor, the user selects a full- 
sized image on a page and chooses "Auto Thumbnail" from the 

10 "Tools" menu. In response to this selection, the 

"FRONTPAGE" brand editor creates the thumbnail image as well 
as a hyperlink to the full -sized image. Once the thumbnail 
and link are created, the full -sized image remains 
accessible to the end user through activation of the 

15 thumbnail image in the manner described above. 

The use of thumbnail images to represent full-sized 
images has many advantages. For example, a primary advantage 
associated with the use of thumbnail images is a 
conservation of system resources, such as network bandwidth, 

2 0 CPU processing time, etc. This conservation of system 
resources results from the low- resolution nature of the 
thumbnail image that minimizes the amount of information 
that is required to be initially downloaded and displayed. 
Accordingly, a system can accommodate the downloading and 

25 display of multiple thumbnail images representing multiple 
full-sized images, such as pages of a document, using 
relatively smaller amounts of system resources when compared 
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to the amount of system resources required to present the 
same information in its full-sized format. 

While the representation of full -sized images through 
the use of low- resolution thumbnail images provides the 
5 advantages noted above, there still remains drawbacks 

associated with their use. For example, the low-resolution 
thumbnail image representation of the full-sized image is 
often of such poor quality that a user is not able to 
discern what information is actually contained within the 

10 counterpart full-sized image. This is particularly true of 
images containing text and associated high frequency 
information. Furthermore, since activation of the thumbnail 
image results in the downloading of the entire file 
comprising the full-sized image, the primary benefit 

15 associated with the use of thumbnail images, namely 
conserving system resources, is effectively defeated. 

Accordingly, a need exists for an improved method and 
system for using a thumbnail image to display information. 
In particular, a need exists for a method and system for use 

20 in browsing information presented to a user in the form of a 
low-resolution image. This is especially desirable for use 
in connection with hand-held devices, such as personal 
digital assistants, where there is limited screen real- 
estate . 
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SUMMARY OF THE INVENTION 

In accordance with this need, the invention is 
generally realized in a system for retrieving information 
from a document. The system includes a document model having 
5 a plurality of data structures representative of the 
components within the document and a thumbnail image 
registered with the document model. The registration is 
accomplished by mapping selected coordinates within the 
thumbnail image to a data structure selected from the 

10 plurality of data structures. A user can interact with the 
thumbnail image coordinates to retrieve information from the 
document as a function of the component (s) mapped to those 
coordinates. In a further embodiment of the invention, the 
retrieved information may be streamed to a word- at -a- time 

15 display while the thumbnail image is altered to provide a 
user with an indication of the context of the streamed 
information. 

In this manner the invention allows a user to interact 

with the low-resolution thumbnail to extract detailed 
20 information from a document without having to view the 

original full-resolution image of the document. 

Furthermore, the invention supplies navigation context to 

word- at -a- time displays. 

Additional features, advantages and objects of the 
25 invention will be made apparent from the following detailed 

description of illustrative embodiments which proceeds with 

reference to the accompanying figures. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

While the appended claims set forth the features of the 
present invention with particularity, the invention, 
together with its objects and advantages, may be best 
5 understood from the following detailed description taken in 
conjunction with the accompanying drawings of which: 

Figure 1 is a block diagram illustrating an exemplary 
computer system on which the present invention resides; 

Figure 2 is a block diagram illustrating a registration 
10 between a Document Model and a smart thumbnail in accordance 
with the present invention; 

Figure 3 is a flow chart diagram illustrating a method 
for creating the smart thumbnail of Figure 2; 

Figure 4 is a flow chart diagram illustrating a method 
15 for retrieving information using the smart thumbnail of 
Figure 2; 

Figure 5 is a screen shot of an exemplary smart 
thumbnail and an associated word-at-a-time display created 
in accordance with the present invention; 
20 Figure 6 is a further representation of the exemplary 

smart thumbnail and the associated word-at-a-time display of 
Figure 5; and 

Figure 7 is flow chart diagram illustrating a method 
for streaming data to the word-at-a-time display illustrated 
25 in Figure 5. 
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DETAILED DESCRIPTION OF THE INVENTION 

Turning to the drawings, wherein like reference 
numerals refer to like elements, the invention is 
illustrated as being implemented in a suitable computing 
5 environment. Although not required, the invention will be 
described in the general context of computer- executable 
instructions, such as program modules, being executed by a 
personal computer, hand-held computer, or the like. 
Generally, program modules include routines, programs, 

10 objects, components, data structures, etc. that perform 
particular tasks or implement particular abstract data 
types. Moreover, those skilled in the art will appreciate 
that the invention may be practiced with other computer 
system configurations, mult i -processor systems, 

15 microprocessor based or programmable consumer electronics, 
network PCs, minicomputers, mainframe computers, and the 
like. The invention may also be practiced in distributed 
computing environments where tasks are performed by remote 
processing devices that are linked through a communications 

20 network. In a distributed computing environment, program 
modules may be located in both local and remote memory 
storage devices. 

With reference to Fig. 1, an exemplary system for 
implementing the invention includes a general purpose 

25 computing device in the form of a conventional personal 

computer 20, including a processing unit 21, a system memory 
22, and a system bus 23 that couples various system 
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components including the system memory to the processing 
unit 21. The system bus 23 may be any of several types of 
bus structures including a memory bus or memory controller, 
a peripheral bus, and a local bus using any of a variety of 
5 bus architectures. The system memory includes read only 

memory (ROM) 24 and random access memory (RAM) 25. A basic 
input /output system (BIOS) 26, containing the basic routines 
that help to transfer information between elements within 
the personal computer 20, such as during start-up, is stored 

10 in ROM 24. The personal computer 20 further includes a hard 
disk drive 27 for reading from and writing to a hard disk, 
not shown, a magnetic disk drive 2 8 for reading from or 
writing to a removable magnetic disk 29, and an optical disk 
drive 3 0 for reading from or writing to a removable optical 

15 disk 31 such as a CD ROM or other optical media. 

The hard disk drive 27, magnetic disk drive 28, and 
optical disk drive 30 are connected to the system bus 23 by 
a hard disk drive interface 32, a magnetic disk drive 
interface 33, and an optical disk drive interface 34, 

2 0 respectively. The drives and their associated computer- 
readable media provide nonvolatile storage of computer 
readable instructions, data structures, program modules and 
other data for the personal computer 20. Although the 
exemplary environment described herein employs a hard disk, 

25 a removable magnetic disk 29, and a removable optical disk 
31, it will be appreciated by those skilled in the art that 
other types of computer readable media which can store data 
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that is accessible by a computer, such as magnetic 
cassettes, flash memory cards, digital video disks, 
Bernoulli cartridges, random access memories, read only 
memories, and the like may also be used in the exemplary 
5 operating environment. 

A number of program modules may be stored on the hard 
disk, magnetic disk 29, optical disk 31, ROM 24 or RAM 25, 
including an operating system 35, one or more applications 
programs 36, other program modules 37, and program data 38. 

10 A user may enter commands and information into the personal 
computer 20 through input devices such as a keyboard 40 and 
a pointing device 42. Other input devices (not shown) may 
include a microphone, joystick, game pad, satellite dish, 
scanner, or the like. These and other input devices are 

15 often connected to the processing unit 21 through a serial 

port interface 46 that is coupled to the system bus, but may 
be connected by other interfaces, such as a parallel port, 
game port or a universal serial bus (USB) . A monitor 47 or 
other type of display device is also connected to the system 

20 bus 23 via an interface, such as a video adapter 48. In 
addition to the monitor, personal computers typically 
include other peripheral output devices, not shown, such as 
speakers and printers . 

The personal computer 20 may operate in a networked 

25 environment using logical connections to one or more remote 
computers, such as a remote computer 49. The remote 
computer 4 9 may be another personal computer, a server, a 
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router, a network PC, a peer device or other common network 
node, and typically includes many or all of the elements 
described above relative to the personal computer 20, 
although only a memory storage device 50 has been 
5 illustrated in Fig. 1. The logical connections depicted in 
Fig. 1 include a local area network (LAN) 51 and a wide area 
network (WAN) 52. Such networking environments are 
commonplace in offices, enterprise-wide computer networks, 
intranets and the Internet. 

10 When used in a LAN networking environment, the personal 

computer 20 is connected to the local network 51 through a 
network interface or adapter 53 . When used in a WAN 
networking environment, the person computer 20 typically 
includes a modem 54 or other means for establishing 

15 communications over the WAN 52. The modem 54, which may be 
internal or external, is connected to the system bus 23 via 
the serial port interface 46. In a networked environment, 
program modules depicted relative to the personal computer 
20, or portions thereof, may be stored in the remote memory 

20 storage device. It will be appreciated that the network 
connections shown are exemplary and other means of 
establishing a communications link between the computers may 
be used. 

In the description that follows, the invention will be 
25 described with reference to acts and symbolic 

representations of operations that are performed by one or 
more computers, unless indicated otherwise. As such, it 
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will be understood that such acts and operations, which are 
at times referred to as being computer-executed, include the 
manipulation by the processing unit of the computer of 
electrical signals representing data in a structured form. 
5 This manipulation transforms the data or maintains it at 
locations in the memory system of the computer, which 
reconfigures or otherwise alters the operation of the 
computer in a manner well understood by those skilled in the 
art. The data structures where data is maintained are 

10 physical locations of the memory that have particular 
properties defined by the format of the data. However, 
while the invention is being described in the foregoing 
context, it is not meant to be limiting as those of skill in 
the art will appreciate that various of the acts and 

15 operation described hereinafter may also be implemented in 
hardware . 

In accordance with the invention, a rendered view of a 
document in the form of a bitmap image or "smart thumbnail" 
is provided as a representation of a document stored within 

20 the computer system, hand-held computer, or the like. In 
this manner, it is possible for a user to interact with the 
smart thumbnail to gain access to the organization, 
components and associated behavior of the document. 
Additionally, the rendered view of the document can be 

25 generated using information in the associated document model 
as an additional way to present to the user meaningful 
information about the document. 
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To allow the user to gain access to the organization, 
components and associated behavior of the document, the 
smart thumbnail is registered with the document. More 
specifically, the smart thumbnail is registered with a data 
5 structure representative of the document generically 
referred to as a "document model . " 

The document model consists of data structures 
containing data representative of components such as text, 
images, vector graphics, and/or multimedia components that 

10 are composited together to form the underlying document. 
The document model may also includes data structures 
representative of the component layout that describe how the 
components that comprise the document are spatially arranged 
in the rendered image of the document . The component layout 

15 may also include data representative of presentation 

information that describes the preferred ordering of the 
components when they are sequentially presented. 

As illustrated in Fig. 2 and by way of example only, a 
simple text document 70 can be described using a document 

20 model 72 having components of increasingly more specific 

semantic units. In the example provided, the components are 
pages, blocks of text, lines of text, and words. 
Preferably, the highest component level is the text document 
itself while the lowest component level is words. In this 

25 manner, the document 70 can be described as having a number 
of page components (Page l...Page N) , each page component 
can be described as having a number of textual block 
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components, e.g., paragraphs, {Text Block l...Text Block N) , 
each textual block component can be described as having a 
number of textual line components (Line Block l...Line Block 
N) , and each textual line component can be described as 
5 having a number of word components (Word 1. . .Word N) . 
Preferably, the data structures representative of these 
components are each provided with an address such that links 
may be used to gain access to the components on an 
individual basis. 

10 For registering the smart thumbnail image to the 

counterpart document, selected coordinates within the smart 
thumbnail image are mapped to selected components using 
layout information in the document model 72 . By way of 
example, Fig. 2 illustrates a smart thumbnail image 74 that 

15 is a low-resolution image representative of the text 

document 70. The smart thumbnail may be registered with the 
document model by mapping: 1) all of the coordinates within 
the smart thumbnail 74 to a page component selected from the 
document model 72; 2) coordinates defining a region 78 

20 within the smart thumbnail 74 representative of a paragraph 
to a textual block component selected from the document 
model 72; 3) coordinates defining a region 82 within the 
smart thumbnail 74 representative of a line of text to a 
line block component selected from the document model 72; 

25 and/or 4) coordinates defining a region 86 representative of 
a word to a word component selected from the document model 
72. 
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More specifically, as illustrated in Figs. 2 and 3, the 
registration of the smart thumbnail 74 to the document model 
72 may be performed by creating in step 90 a full- sized 
bitmap image replica 88 of the document. Alternatively, in 
5 step 91, the full-sized bitmap image replica 88 can be 

generated using the layout information in the document model 
72. Still further, the full-sized bitmap image replica 88 
could be generated using an internal representation of the 
document created, for example, in the printing process. 

10 Within the full-sized bitmap image 88, coordinates of 

the bits that are representative of selected components from 
the document model 72 are identified in step 92. For 
example, the coordinates of a rectangle in which reside 
those bits that together give the appearance of a word are 

15 identified. In step 94, the identified coordinates are 
mapped to a corresponding component selected from the 
document model 72. This mapping preferably provides the 
identified coordinates with a link to the address of the 
components to which the coordinates are mapped. 

20 Once the full-sized bitmap image has been mapped to all 

of the desired components, the smart thumbnail 74 low- 
resolution image is created in step 96 from the full-sized 
bitmap image 88. As will be appreciated by those of skill 
in the art, the creation of the low-resolution image may be 

25 performed by sub-sampling the full-sized bitmap image 88 

using, for example, a multi -resolution pyramid technique or 
the like. During this process, the coordinates within the 
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full -sized bitmap image 88 that are mapped to the components 
are translated to the scale of the low-resolution image. In 
this manner, the smart thumbnail 74 is registered to the 
document model 72. In Fig. 2, the layered pyramid 
5 corresponds to different resolutions of the image of the 

associated document. The higher up the pyramid, the smaller 
the image becomes. The smallest image is shown as 
corresponding to the thumbnail. 

For generating the bitmap image in accordance with step 

10 90 of Fig. 3, various tools known in the art are available 
for use. For example, Optical Character Recognition (OCR) 
tools can be used in conjunction with document description 
formats to generate information pertaining to positions of 
text within a rendered image of a simple text document . 

15 Similar information may be generated using known document - 
processing techniques which analyze a scanned document into 
a hierarchical set of groups without performing explicit OCR 
character recognition. This positional information may then 
be used to map the identified coordinates to the appropriate 

20 semantic units selected from the document model 72. 

To allow a user to interact with the smart thumbnail 
74, the smart thumbnail is presented on the display 47 
associated with computer 70 of Fig. 1. In this manner, a 
user can manipulate a display cursor, using the mouse 42, 

25 keyboard 40, or the like, to indicate a specific position 
within the displayed smart thumbnail 74 for which more 
detailed information is desired to be retrieved. The smart 
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thumbnail 74 can be presented to the user in connection with 
any number of application programs 36 such as, for example, 
an Internet browser application, a word processing 
application, a spreadsheet application, or like type of 
5 application whose underlying function is information 
presentation . 

For retrieving the detailed information related to the 
positioning of the cursor, the coordinate in the smart 
thumbnail 74 that underlies the position of the cursor is 

10 determined as illustrated in step 100 of Fig. 4. It will be 
appreciated that determining the coordinate in the smart 
thumbnail 74 underlying the position of the cursor likewise 
allows the link to the component mapped to that coordinate 
to be identified as shown in step 102. Thus, using the 

15 identified link, the application displaying the smart 

thumbnail can issue a request in step 104 that the data 
represented by the component associated with the identified 
link be retrieved for subsequent display to the user. 
Returning to Fig. 2 and by way of example, if the user were 

20 to position the cursor over the coordinates that define the 
region 86 within the smart thumbnail 74, data represented by 
the page component, textual block component, textual line 
component, and/or word component can be retrieved and 
displayed to the user. The information retrieved depends 

25 upon which of the component (s) selected from the document 
model 72 were mapped to the region 86. 
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From the foregoing, it will be appreciated that the use 
of smart thumbnails allows for the retrieval and viewing of 
information selected from a document without having to 
download the entirety of the counterpart document image. 
5 Thus, among other things, the subject invention has the 
advantage of improving upon the conservation of resources 
normally associated with using thumbnails. This ability to 
retrieve parts of documents also has the advantage of 
allowing a user to quickly and efficiently discern what is 

10 contained in a document corresponding to an unreadable 
thumbnai 1 image . 

For displaying information retrieved from a text 
document, it is preferred that a word-at-a-time display 
(WAATD) be used. WAATDs are known in the art and are 

15 generally used to present one or more words as a text stream 
to a viewer in a small, restricted, stationary window. For 
example, Tenax Software Engineering provides a downloadable 
Java applet, entitled u Cornix," for use in providing WAATDs 
on Web pages. Since WAATD allow text documents to be read 

20 without requiring a user to move their eyes, WAATDs have 
been seen to increase reading times by as much as 90%. 

With reference to Figs. 2,5 and 6, the displaying of 
data retrieved from a document model within a WAATD display 
110 is preferably performed as a function of the 

25 presentation information maintained in the document model 
72 . The presentation information may be used to navigate 
the global hierarchy of the document to stream information 
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to the WAATD 110. By way of example, as illustrated in Fig. 
7, given a starting word component within the document model 
72, preferably defined in step 120 by the user positioning 
the cursor over a coordinate in the smart thumbnail, the 
5 presentation information may direct that each word component 
following and including the starting word component within 
the textual line component that includes the starting word 
component be streamed to the WAATD in steps 122-126. In 
steps 128-130, the streaming to the WAATD of the word 

10 components can then be repeated for the next textual line 

component. In steps 132-134, the streaming to the WAATD of 
the word components from each of the textual line components 
may be repeated for the next textual block component . In 
steps 13 6-138, the streaming to the WAATD of the word 

15 components from each of the textual line components from 

each of the textual block component may then be repeated for 
the next page component . 

Using the method illustrated in Fig. 6, all word 
components from the starting word component to the last word 

2 0 component in the hierarchy of the document model may be 
streamed to the WAATD. It will be appreciated, however, 
that the streaming of word components to the WAATD need not 
continue until the end of the document. Rather, the 
streaming of components to the WAATD can be restricted to a 

25 delimiter reflecting any unit of document organization. 

Furthermore, the speed and/or manner in which components are 
presented within the WAATD can be controlled as a function 
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of the type of component being streamed to the WAATD 110. 
By way of example, titles could be presented relatively 
slower than body text or the font, color, etc. of the 
information displayed may be changed in the WAATD to 
5 visually notify to the user that some unique type of 
information is being presented. 

Further use of the document model may also be made for 
causing single pages of the document to be controllably 
displayed to the viewer in thumbnail format while being used 

10 in connection with the WAATD 110. As illustrated in Fig. 6, 
a first page component (Page 1) from the document model may 
be displayed and, in response to a user interacting with a 
forward page control (FP) and a reverse page control <RP) 
the next or previous page in the document, respectively, may 

15 be displayed. For example, to traverse from the second page 
component (Page 2) to the first page component (Page 1) , the 
user would interact with the RP control as shown in Fig. 6. 
An additional field 13 0 may also be used to display the page 
number thereby providing page context to the user. This 

20 manner of presenting information is particularly 

advantageous for use in connection with PDAs and other 
handheld devices having a small amount of display real 
estate . 

While standard WAATD s have the advantage of improving 
25 reading time, manufacturers remain reluctant to incorporate 
WAATD s into products because readers find the use of WAATD s 
to be sometimes unsettling. For example, readers are often 
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unable to discern from where in the document the streaming 
words are being extracted. Accordingly, WAATDs tend to be 
very poor for understanding context relative to overall 
document organization and navigation. To solve this 
5 problem, a smart thumbnail may be utilized in connection 
with the WAATD 110. 

To provide context to the words being streamed to the 
WAATD 110, a smart thumbnail corresponding to the document 
from which the streaming words are being extracted may be 

10 manipulated so as to indicate to a reader where in the 

document the streamed text organizationally resides. By way 
of example and with reference to Fig. 5, the smart thumbnail 
74 can have the coordinates corresponding to the word 
components that are streamed to the WAATD display change 

15 color, be highlighted, etc. 112. In this manner, the smart 
thumbnail provides visual clues to the reader that function 
to track the streaming of words to the WAATD. 

The altering of the rendition of the smart thumbnail 74 
for the purpose of tracking within the context of the smart 

20 thumbnail 74 the streaming of words to the WAATD 110 can be 
accomplished using standard functions from a graphical 
interface, such as Microsoft's graphical device interface 
(GDI) . It will also be appreciated that the GDI functions 
can be used to change the rendering of the smart thumbnail 

25 in response to other factors such as, for example, 

highlighting coordinates in the smart thumbnail in response 
to a query performed on the underlying document model . 
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More specifically, the rendering information required 
by the graphical interface functions for effectuating an 
alteration of the coordinates of the smart thumbnail may be 
stored as part of the document model 72. In this manner, 
5 the document model can be used to control the rendering of 
the thumbnail to highlight information, for example, using 
rendering rules such as "use the text block highest on the 
page and with the boldest font to highlight the title." 
Using such control, different components can be rendered 

10 differently based on their type. 

Still further, the WAATD may be used to in connection 
with a computer, personal digital assistant, or the like to 
display Web content retrieved from the internet. Preferably, 
the Web content, in the form of a document model, is 

15 streamed to the WAATD one word component at a time as 

described above. However, when the word component of the 
Web content document model is further defined to be a 
hyperlink/button component, the WAATD display can vary the 
presentation of the hyperlink component to allow a user to 

20 interact with the hyperlink component. For example, the 

WAATD may pause when such a component is displayed to allow 
the user time to activate the hyperlink. The pausing of the 
display may continue until the user interacts with the link 
or otherwise notifies the graphical user interface that the 

25 link is not of interest. Still further, the display of the 
hyperlink may be caused to blink, flash, change color or 
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otherwise visually attract the attention of the user when 
displayed in the WAATD. 

In yet another embodiment, the display of the smart 
thumbnail may be altered to indicate the presence of a 
5 hyperlink. For example, with reference to Fig* 5, one color 
(blue) could be used to indicate the context of the 
information streamed to the WAATD with the color changing 
(to red for example) over those contextual locations 
corresponding to a streamed hyperlink. In this manner, the 

10 user may click on the appropriately colored location of the 
thumbnail to invoke the hyperlink. Preferably, for 
hyperlinks that are proximate to one another, a means (such 
as using multiple colors for example) is used to 
differentiate the rendering of the hyperlink locales within 

15 the thumbnail image to avoid what would appear to the user a 
one continuous hyperlink. 

Still further, the document model may be used to 
control the order in which information is presented in the 
WAATD. For example, the first item of information displayed 

2 0 to the viewer could be the nearest title to the location 
activated on the smart thumbnail, the first word of a 
paragraph which has been selected by a user, etc. 
Additionally, the WAATD can be used to cycle through lists 
or columns of data. 

25 While the invention has been primarily described herein 

using a simple text document as the exemplary document that 
is registered with a smart thumbnail, it will be appreciated 
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by those of skill in the art that the invention is not 
intended to be so limited. Accordingly, the invention 
described herein contemplates more complex document models 
wherein the components may be divided into classes such as 
5 images, vector graphics, etc. as well as text. As will be 
further appreciated, these additional components are 
preferably handled differently than textually based 
components during the rendering process. For example, 
images could be displayed in specialized viewers while 

10 vector graphics could be independently redrawn thus avoiding 
the averaged out sampling of the images that would result 
from the process used to create the smart thumbnail image. 

In another preferred embodiment of the invention, the 
document that is registered with the smart thumbnail is an 

15 Extensible Markup Language (XML) document. As will be 

appreciated by those of skill in the art, XML provides to 
authors of documents a way of marking up the content of the 
document using tags that function to semantically organize 
the document. Consequently XML provides a standard way to 

20 better communicate the relevance of the content of the 
document when the document is registered with the smart 
thumbnail. For example, using XML, text components within a 
document can be more specifically characterized using tags 
that identify the text components as titles, headings, etc. 

25 In particular, XSL has been developed in XML to describe 
document layout which can be used for describing document 
models. This is described in LEVEL 1 DOCUMENT MODEL 
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SPECIFICATION, VERSION 1.0, W3C Working Draft, July 20, 1998 
which is incorporated herein by reference in its entirety. 

In view of the many possible embodiments to which the 
principles of this invention may be applied, it should be 
5 recognized that the embodiment described herein with respect 
to the drawing figures is meant to be illustrative only and 
should not be taken as limiting the scope of invention. For 
example, those of skill in the art will recognize that the 
elements of the illustrated embodiment shown in software may 

10 be implemented in hardware and vice versa or that the 

illustrated embodiment can be modified in arrangement and 
detail without departing from the spirit of the invention. 
Therefore, the invention as described herein contemplates 
all such embodiments as may come within the scope of the 

15 following claims and equivalents thereof. 
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We claim: 

A. A system for linking to a document, comprising: 
a document model, representative of the document, 

having a plurality of data structures representative of 
5 components within the document; and 

a thumbnail image registered with the document model 

such that selected coordinates within the thumbnail image 

are each mapped to a data structure selected from the 

plurality of data structures. 
10 2. The system as recited in claim 1, wherein the 

document is a text document and the components comprise one 

or more page components, textual block components, textual 

line components and word components. 

3. The system as recited in claim 1, wherein the 
15 document is an XML document. 

4. The system as recited in claim 1, wherein the 
components comprise images. 

5. The system as recited in claim 4, wherein the 
images comprise vector graphics . 

2 0 6. The system as recited in claim 1, further 

comprising a word-at-a-time display associated with the 
thumbnail image for displaying the data represented by 
selected components from the document model, the components 
selected in response to interaction with the thumbnail. 

25 7. The system as recited in claim 1, wherein the 

components are individually addressable. 
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A . A method for registering a low-resolution 
thumbnail image with a document model having a plurality of 
data structures representative of components within a 
document, the method comprising the steps of: 
5 creating a full- sized bitmap image representative of 

the document; 

identifying coordinates within the full-sized bitmap 
image ; 

mapping selected coordinates within the full-sized 
10 bitmap image to components selected from the document model; 
and 

reducing the full -sized bitmap image into the low- 
resolution thumbnail image. 

9. The method as recited in claim 8, wherein the 

15 document is a text document and the components comprise one 
or more page components, textual block components, textual 
line components and word components. 

10. The method as recited in claim 8, wherein the 
document is an XML document . 

20 11. The method as recited in claim 8, wherein the step 

of mapping further comprises the step of providing an 
address link to a computer storage location between the 
coordinates and each component selected from the document 
model mapped to the coordinates. 

25 12. The method as recited in claim 8, wherein the step 

of identifying further comprises the step of identifying 
coordinates that define a unit of text. 
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13. The method as recited in claim 8, wherein the step 
of reducing further comprises the step of sub-sampling the 
full -sized bitmap image. 




A method for retrieving information from a 



5 document represented by a thumbnail image having coordinates 
registered with components selected from a document model 
representative of the document, the method comprising the 
steps of : 

sensing the position of a cursor over the thumbnail 
1 0 image ; 

determining the coordinates within the thumbnail image 
corresponding to the sensed cursor position; and 

retrieving data from the document corresponding to the 
component from the document model registered with the 
15 determined coordinates. 

15. The method as recited in claim 14, further 
comprising the step of streaming to a word- at -a- time display 
the data retrieved from the document. 

16. The method as recited in claim 15 , further 
2 0 comprising the step of altering the appearance of the 

thumbnail image to provide an indication of the information 
streamed to the word- at -a- time display. 

17. The method as recited in claim 15 , wherein the 
step of streaming is continued until a delimiter reflecting 

25 a unit of document organization is reached. 

life. A computer- readable medium comprising instructions 
for retrieving information from a document represented by a 
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thumbnail image having coordinates registered with 
components selected from a document model representative of 
the document, the instructions performing the steps of: 
sensing the position of a cursor over the thumbnail 
5 image ; 

determining the coordinates within the thumbnail image 
corresponding to the sensed cursor position; and 

retrieving information from the document corresponding 
to the components from the document model registered with 
10 the determined coordinates. 

19. The computer -readable medium as recited in claim 

18, further comprising instructions for performing the step 
of streaming to a word-at-a-time display the information 
retrieved from the document . 

15 20. The computer- readable medium as recited in claim 

19, further comprising instructions for performing the step 
of altering the appearance of the thumbnail image to provide 
an indication of the information streamed to the word-at-a- 
time display. 

20 21. The computer-readable medium as recited in claim 

19, wherein the step of streaming is continued until a 
delimiter reflecting a unit of document organization is 
reached. 



25 for Registering a low-resolution thumbnail image with a 
document model having a plurality of data structures 




A computer- readable medium comprising instructions 
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representative of components within a document, the 
instructions performing the steps of: 

identifying coordinates within a full-sized bitmap 
image ; 

5 mapping selected coordinates within the full -sized 

bitmap image to components selected from the document model; 
and 

reducing the full -sized bitmap image into the low- 
resolution thumbnail image. 
10 23. The computer-readable medium as recited in claim 

22, wherein the step of identifying further comprises 
identifying coordinates that define a unit of text. 
24r. A hand-held computer, comprising: 
/4 memory adapted to store thereon a document model, 
15 representative of a document, the document model having a 
plurality of data structures representative of components 
within the document; and 

a display adapted to display a thumbnail image 
registered with the document model and a word-at-a-time 
2 0 display; 

wherein the thumbnail image is registered with the 
document model such that selected coordinates within the 
thumbnail image are each mapped to a data structure selected 
from the plurality of data structures; and 
25 wherein the word-at-a-time display is adapted to 

display data represented by components selected from the 
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document model in response to interaction with the 
thumbnail . 

25. The hand-held computer as recited in claim 24, 
wherein the document is a HTML document. 
5 26. The hand-held computer as recited in claim 24, 

wherein the document model comprises one or more hyperlinks 
and the word-at-a-time display is adapted to display 
hyperlinks in a manner that attracts the visual attention of 
a user. 

10 27. The hand-held computer as recited in claim 25, 

wherein the manner that attracts the visual attention of the 
user is flashing the hyperlink in the word-at-a-time 
display. 

28. The hand-held computer as recited in claim 24, 

15 wherein the thumbnail image is adapted to track the context 
of information streamed to the word-at-a-time display. 

29. The hand-held computer as recited in claim 28, 
wherein the document comprises one or more hyperlinks and 
the thumbnail image is adapted to display the context of 

20 streamed hyperlinks in a manner adapted to visually attract 
a user. 

30. The hand-held computer as recited in claim 29, 
wherein the manner adapted to visually attract the user 
comprises flashing a portion of the thumbnail image 

25 corresponding to the streamed hyperlink. 
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ABSTRACT 

A system for retrieving information from a document. 
The system includes a document model representative of the 
document having a plurality of data structures 
5 representative of components within the document and a 
thumbnail image registered with the document model. The 
registration is accomplished by mapping selected coordinates 
within the thumbnail image to a data structure selected from 
the plurality of data structures. In this manner, a user 

10 can interact with the thumbnail image coordinates to 
retrieve data from the document as a function of the 
components mapped to those coordinates. In a further 
embodiment of the invention, the retrieved information may 
be streamed to a word-at-a-time display. This is 

15 particularly useful when used in connection with the display 
of low-resolution images on hand-held devices. 
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